Adiabatic quantum algorithms as quantum phase transitions: 1 st versus 2 order 
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In the continuum limit (large number of qubits) , adiabatic quantum algorithms display a remark- 
able similarity to sweeps through quantum phase transitions. We find that transitions of second or 
higher order are advantageous in comparison to those of first order. With this insight, we propose 
a novel adiabatic quantum algorithm for the solution of 3-satisfiability (3-SAT) problems (exact 
cover), which is significantly faster than previous proposals according to numerical simulations (up 
to 20 qubits). These findings suggest that adiabatic quantum algorithms can solve NP-complete 
problems such as 3-SAT much faster than the Grover search routine (yielding a quadratic enhance- 
ment), possibly even with an exponential speed-up. 

PACS numbers: 03.67.-a, 03.67.Lx, 73.43.Nq, 64.70.-p. 



The realization that quantum algorithms (e.g., 0,0) 
can solve certain problems much faster than (known) 
classical methods is one of the main motivations for con- 
structing scalable quantum computers. Unfortunately, 
these efforts are strongly hampered by the decoherence 
induced by the inevitable coupling to the environment, 
which tends to destroy the fragile quantum features 
needed for these quantum algorithms. One idea to over- 
come this obstacle is adiabatic quantum computation Q 
where the solution to the problem to be solved is encoded 
in the ground state of a suitably designed Hamiltonian 
H ou t. In order to reach this (unknown) ground state, 
adiabatic quantum algorithms exploit the adiabatic the- 
orem: A system described by a time-dependent Hamil- 
tonian H{t) with H{t)\$ n {t)) = E n (t) | *„(*)) initially 
prepared in its ground state |\&o) will approximately stay 
in its (instantaneous) ground state - provided the evolu- 
tion of H(t) is slow enough (* | H < (E n - E ) 2 . 
Starting with an initial Hamiltonian H lu whose ground 
state is known and easy to prepare, a sufficiently slow 
evolution into H out , for example 
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FIG. 1: Sketch of the level structure (ground state and first 
excited state) of the Grover Hamiltonian in Eq. (J2j. 

with a quadratic speed-up 0- An adiabatic version of 
Grover's algorithm is defined by the Hamiltonian 



H(g) = (l-g) [1 - |s) (s\]+g[l-\w) (t 



(2) 



H(t) = [l-g(t)]H in +g(t)H out , 



(1) 



where the parameter g(t) runs from to 1, generates the 
desired final ground state. With a sufficiently cold and 
weakly coupled environment, the occupation of the in- 
stantaneous ground state should be more robust against 
the impact of decoherence, see, e.g., Q. The adiabatic 
condition (\T/ 1 H \^ n ) <C (E n — E ) 2 relates spectral 
properties of H(t) with the runtime T necessary to ob- 
tain a desired probability of the instantaneous ground 
state - which can be interpreted as the algorithmic com- 
plexity of the quantum algorithm. However, especially 
for NP-complete problems such as 3-SAT, the maximum 
speed-up achievable by adiabatic quantum algorithms is 
still not completely clear, see, e.g., 0,0 0] In this Let- 
ter, we exploit the analogy to quantum phase transitions 
H in order to gain new insight into these questions. 

Let us start with one of the simplest examples: the 
Grover algorithm, which accomplishes the task to find a 
marked item in an unsorted database with N = 2 n items 



with \s) = J2x=o \ x ) /v^V denoting the superposition of 
all numbers from Q to N — 1 and \w) the marked state, 
respectively. Since in this case the commutator between 
initial and final Hamiltonians [Hi n ,H out ] is small, one 
can nearly diagonalize them simultaneously and the g- 
dependent spectrum will consist of nearly straight lines 
- except near g c = 1/2, where we have an avoided level 
crossing, see Fig. ^ I n the (continuum) limit of n f oo, 
this corresponds to a first-order quantum phase tran- 
sition from |s) = |— ► • • • — ►) to \w) = |T4 • • • TTI) a t the 
critical value g c — 1/2. Such a first-order transition is 
characterized by an abrupt change of the ground state 
(|s) for g < g c and \w) for g > g c ) resulting in a dis- 
continuity of a corresponding order parameter such as 
(iP(g)\dH/dg\^(g)) = dE/dg. 

Typically, quantum phase transitions of first order are 
associated with a (/-dependent energy landscape sketched 
in Fig.El where the two competing ground states are sep- 
arated by an energy barrier. During the phase transition, 
the system has to tunnel through that barrier between 
\s) and \w) in order to stay in the ground state. Since 
naturally the strength of this barrier increases with the 
system size n, one would expect the tunneling time to 
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FIG. 2: Sketch of the energy landscape for a first-order tran- 
sition with the black dot indicating the ground state. 

scale exponentially - and indeed, the optimal runtime 
behaves as T = 0{VN) = 0{2 n / 2 ) for the Grover algo- 
rithm described above |9(. 

The abrupt change of the ground state and the en- 
ergy barrier suggest that first-order transitions are not 
the best choice for the realization of adiabatic quantum 
algorithms. In order to study this point in more detail, 
let us consider a simple example for a second-order tran- 
sition - the quantum Ising model in the presence of a 
transverse field as defined by the Hamiltonian 

n n 

H(g) = -(1 - g) < - g £ a z a a z a+1 , (3) 

a— 1 a— 1 

where a^ v,z denote the Pauli matrices acting on the cvth 
qubit. This Hamiltonian is invariant under a global 180- 
degree rotation around the x-axis which transforms all 
qubits according to o z a — > —o z a . The initial (g = 0) 
ground state is unique \s) = |— > • • ■ — >), whereas the fi- 
nal ground state (g — 1) becomes two- fold degener- 
ate \wi) = |t ... |), \w 2 ) = || ... |), and thereby breaks 
this symmetry. Typically, such a symmetry-breaking (or 
restoring) change of the ground state corresponds to a 
second-order phase transition. For the Ising model, this 
expectation can be confirmed analytically by an exact 
diagonalization of the Hamiltonian via Jordan- Wigncr 
and Bogoliubov transformations (cf. For such a 

second-order phase transition, the ground state changes 
continuously (i.e., there is no jump in an order parame- 
ter) and the energy barrier observed in first-order tran- 
sitions is absent, see Fig. [3J Consequently, one would 
expect that the system should find its way from the ini- 
tial to the final ground state much easier in this situation 
- and indeed, the optimal runtime (needed to stay in the 
ground state) scales polynomially in this case since the 
minimum gap behaves as 0(l/n), cf. H03. 

Note, however, that symmetry-breaking is no guaran- 
tee for a second-order transition. As a counter-example 
(and in order to bring out the difference between first 
and second order transitions a bit more), let us consider 
another simple model Hamiltonian 

n 

H{g) = (1 - g)(l - \s) («|) - g £ « +1 , (4) 

a=l 

which combines the initial Hamiltonian of the Grover 
problem with the final Hamiltonian of the Ising model. 
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FIG. 3: Sketch of the level structure (top), i.e., ground state 
and first excited state, and the energy landscape (bottom) of 
the Ising model as a symmetry-breaking second-order phase 
transition with the black dots indicating the unique (left) or 
degenerate (right) ground state(s). 

Even though it has the same symmetry and the same 
initial and final ground states as the Ising model, the 
above Hamiltonian leads to an avoided level crossing cor- 
responding to a first-order transition (as can be seen from 
the local geometry of the spectrum, data not shown jllj). 
As one would expect from the existence of the energy 
barrier in a first-order transition, cf, Fig. |3 the scaling 
of the runtime is exponential in this situation @. The 
main difference between the Ising model and the Hamil- 
tonian above is that the latter choice involves n-qubit 
interactions \s) (s\ = Yl^=i0- + °a)/2 an d therefore the 
bit structures of the initial and the final Hamiltonians 
are very different. These findings may shed additional 
light onto the recent discussions in Refs. @, ^2- 

After having motivated the advantages of second-order 
phase transitions for adiabatic quantum computation, let 
us try to apply these findings to the solution of non-trivial 
computational problems. In order to compare our results 
to the literature, we are going to discuss a (well studied) 
special case of a 3-satisfiability problem: exact cover-3. 
This problem can be described as follows: a string of n 
bits z a £ {0, 1} must satisfy m constraints called clauses. 
Each clause involves three bits a,/3, r y£ {1, . . . , n} and 

Za + Zfi + Z 1 = 1 (5) 

is the constraint to be satisfied for every triple (a,/?, 7). 
Evidently, the solution to this problem, i.e., the bit string 
satisfying all m constraints, is easy to verify but possi- 
bly hard to find - i.e., it belongs to the class NP. It can 
even be shown that exact cover-3 is NP-complete, i.e., 
all other NP-problems (such as factoring or the traveling 
salesman problem) can be mapped onto exact cover-3 
with polynomial overhead. Of course, in order to study 
the speed-up of quantum algorithms in comparison with 
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classical methods, we are mostly interested in hard in- 
stances of this class of problems. First of all, it is believed 
3] that problems with a unique solution are among the 
hardest instances of exact cover-3. A further indication 
of the complexity can be obtained by treating the m con- 
straints of the form given by Eq. (JSJ as a system of linear 
equations. Clearly, for m = n linearly independent con- 
straints, the solution can be found easily. This suggests 
that instances with a small number of clauses - which 
still possess a unique solution - are particularly hard to 
solve, see also We shall consider both cases in the 
following and compare them. 

In previous approaches (see, e.g., fj]), the Hamilto- 
nian H out whose ground state encodes the solution to the 
aforementioned problem was constructed by assigning a 
fixed energy penalty to each violated clause. In contrast 
to this conventional choice (which involves three-qubit in- 
teractions) we shall use an alternative representation re- 
quiring two-qubit interactions only. (In view of an exper- 
imental setup, two-qubit interactions are probably favor- 
able.) To this end, we sum the terms (a z + a% + a* — 1 ) 2 /4 
over all clauses (a, (3, 7) and obtain [131 ] 

n - n 

a, (3=1 a=l 

plus an irrelevant constant. Here N a denotes the number 
of clauses involving the bit a and M a p is the number of 
clauses involving both bits a and (3. The above Hamilto- 
nian corresponds to a frustrated anti-ferromagnet in an 
external field, except that the interaction topology M a p 
is defined by the clauses and not by physical neighbor- 
ship. For satisfiable problems, it has the same ground 
state (the solution) as the Hamiltonian used in |3j, but 
some of the excitation energies differ. 

As we have seen in the example in Eq. @, the order 
of the phase transition crucially depends on the initial 
Hamiltonian. Therefore, the remaining task is to find a 
suitable initial Hamiltonian which respects the bit struc- 
ture of the final Hamiltonian in Eq. © and whose ground 
state breaks a global symmetry - which hopefully gen- 
erates a second-order transition. The symmetry of the 
final Hamiltonian we exploit here is its invariance under 
rotations around the £ z -axis, where 

n 

S z = $>*. (7) 

a=l 

An initial Hamiltonian in which this symmetry is spon- 
taneously broken is the Heisenberg ferromagnet 

1 ™ 

Hi n = -- ^2 M a p<T a -<Tp. (8) 

a, (3=1 

Note that both Hamiltonians have the same interac- 
tion topology M a fl, i.e., bit structure. In the con- 
tinuum limit, the ground state manifold of JSJl be- 
comes S'0(3)-degenerate and contains the separable state 



\s) = | — > • • • — >). This degeneracy grants us the free- 
dom of choosing the most appropriate initial state for 
the adiabatic algorithm. The total angular momentum 
E 2 around the z-axis is conserved during the evolution. 
In the final state, S z counts the difference A between 
the numbers of zeros and ones in the solution (Hamming 
weight). Therefore, in order to gain a significant final fi- 
delity, the initial state should be completely contained in 
the relevant subspace = A|\&). A suitable initial 

state can be generated by the projector 

which is just the Fourier decomposition of the Kronecker 
symbol 5 (A — S z ) and involves single-qubit rotations 
only. Alternatively, one could use an app ropriate energy 
penalty such as (E z — A) 2 , see also UJ. Of course, for 
this initial state preparation, we have to know A. How- 
ever, this is not a major obstacle: we have found that for 
the hard instances we consider (see results), the number 
of ones in the solution is sharply peaked around A = n/3. 
In any case, the overhead of trying every possible value 
of A scales linear (i.e., polynomial) in n. 

Numerically, we found that an initial Hamiltonian cor- 
responding to the transversal x, y-ferromagnet 

1 n 

h ^=— a e m «p + <4) > ( io ) 

a, 13=1 

yields an even better performance than the one in Eq. JSJ. 
In this case, the exact S'0(3)-degeneracy of the ground 
state of Eq. |JSJ is replaced by an approximate 0(2)- 
degeneracy (mean-field approximation) generated by E z , 
i.e., the state in Eq. © has a large overlap with the exact 
ground state of Eq. |(TU)| in the relevant E 2 -subspace. 

In order to test the performance of the linear interpo- 
lation between the Hamiltonians (|10[1 and JJjJ proposed 
here and to compare it with the conventional interpola- 
tion scheme used in for example, we have simulated 
the adiabatic quantum algorithms numerically |l5|. For 
different qubit numbers n, we have randomly generated 
instances of the exact cover-3 problem with a unique so- 
lution in complete analogy to the procedure described 
in In addition - as motivated by the comments af- 
ter Eq. © and Ref. - we have also generated hard 
subsets of uniquely satisfying agreements with especially 
few clauses. Technically, this was done by keeping those 
instances that had m < round(2n/3) clauses only. 

The results of our numerical simulations are presented 
in Fig. 2| For the conventional interpolation scheme 
applied to randomly generated instances admitting 
unique solutions, we reproduce the results known from 
the literature: Fits to the median runtime yield the 
same quadratic scaling as in Q and for the correspond- 
ing minimum fundamental gap we obtain similar results 
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FIG. 4: Runtime T necessary to reach final fidelity of 1/8. 
Data points show the median out of 100 instances, whereas 
error bars display the 95% confidence interval on the median. 



as m (not shown, [13). However, it becomes visible 
that for the instances with few clauses (which we believe 
to be very hard), the performance of the conventional 
scheme |3| deteriorates significantly. This is consistent 
with the observation that the minimum gap is consider- 
ably smaller for those hard instances than for the other 
instances with more clauses in the conventional interpo- 
lation scheme (data not shown flll|i. 

In comparison, the novel adiabatic quantum algorithm 
(x, y-network) based on a linear interpolation between 
(fTUj) and © proposed here yields a superior performance 
and scaling behavior up to the range of n = 20 qubits 
- which becomes even more pronounced for the hard in- 
stances. Note that the data points for those hard in- 
stances cluster around qubit numbers that can be divided 
by three, which is probably a consequence of our restric- 
tion m < round(2n/3). Unfortunately, the error bars 
and the small problem sizes (albeit at the limit of our 
computational abilities) do not allow to draw conclusions 
whether the limiting scaling is exponentially or polynomi- 
ally for this NP-complete problem. However, our results 
strongly indicate that the scaling is better than that of 
the Grover search routine with T — 0(yN). Although 
these results are encouraging, it should be stressed that 
the average behavior (median) can be quite different from 
the worst case scenario. Indeed we did also encounter in- 
stances for which the required runtime was significantly 
longer and the associated gap was very small (the me- 
dian is insensitive to these). In many of these extremal 
cases, our novel algorithm was still superior, but some- 
times the conventional scheme Q performed better on 
these instances. 

In summary, the analogy to quantum phase transitions 
facilitates a better understanding of adiabatic quantum 
algorithms. Apart from the vanishing energy gap at the 
critical point (in the continuum limit), another typical 
signature for the occurrence of a phase transition is the 



divergence of the entanglement, cf. ^(|. The energy bar- 
rier occurring in first-order transitions provides an intu- 
itive explanation for the exponential scaling of the run- 
time observed in these situations. The absence of this 
barrier in transitions of second (or higher) order gives 
raise to the hope that suitably designed adiabatic quan- 
tum algorithms might yield a much better scaling behav- 
ior - possibly even an exponential speed-up. 
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